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ABSTRACT 


PeCiesecUcotonm el Convolutional encoding and sequential 
decoding is given as background for the experimental phase 
of this research. A modified stack algorithm is programmed 
to simulate a sequential decoder for use in the study of 
time-varying convolutional codes. 

The decoder simulator is used to analyze the structure 
of codes with the aim of finding a systematic method by 
wierecm GO CONStruct time-varying convolutional codes with 
Meecececoding properties. Some difficulties in construction 
techniques are discussed. 

Heabensive COMmpuver Simulation comparing decoding perfor- 
mance of time-varying codes to that of fixed codes is 
memO@rbed. | lhe conclusion of these comparisons is that the 
time-varying codes studied thus far are of theoretical 


mae rest Only. 
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ie Ot RODU CTT em 


A. BACKGROUND 

mince noise is always present in electrical communica- 
Pleme Circuits, there is a non-zero probability that trans- 
ferecea Signals will be altered causing errors at the 
receiver. When digital information is transmitted directly 
from machine to machine, erroneous reception of even a 
Sinele Dit of information may change the complete meaning 
Speem@cssagse. ib is for this reason that error-correcting 
codes have been devised. These codes should provide a means 
Aecommumicaving with any required degree of reliability, 
and should be easily implemented with existing digital 
equipment. 

Shounen ie tas shown that codes meeting the first cri- 
werden do exist provided that the data rate does not exceed 
some maximum, called channel capacity. The statistical 
characteristics of the space channel have indicated that 
the use of convolutional codes with sequential decoding is 
eHow omebnCwbectEmetmods Of attaining the reliability required 
Scr memiomeypenolechanne!. In this chapter a general con- 
volutional encoder and sequential decoding are briefly 
ee ced me me erlpuion Of the channel model used in 


Simulation studies is also given. 





bee CONVOLUTIONAL CODES 

Forney [2] has given the following definition: "An 
(n,k) convolutional encoder over a finite field, F, is a 
k-input n-output constant linear causal finite-state sequen- 
tial sieemscs The rate of a general convolutional encoder 
is defined to be k/n. 

A general binary rate % convolutional encoder of memory 
ieee shown im Figure 1. The input, {x,}, is a binary 


k 


sequence, called the information sequence, and the outputs 


( 
k 


tated to form a single sequence or transmitted independently. 


are two binary sequences, {y 1)4 and ty ty, either commu- 

Mmemeach Unit Of time the encoder transforms one input digit 

mego a sequence Of two output digits. It can be seen from 

Figure 1 that the two output digits depend on the present 

ia Oriavtonm Gigit and the m previous information digits. 
The transform A(D) of the sequence Ay 287 sAnr+ss is 


defined as a formal power series in the indeterminate, D. 


A(D) = a 5 


0 


If the sequence Ay 28,24 has only a finite number of 


2 


non-zero elements then A(D) is a polynomial in D. The 


D-transforms of the sequences ee ae. 
PAG. .Q) (1),2 4 . ofl) pm 
G,(D) = +g, °D + g5°°D ae oe 
Bere) (2) Gay C2) in 
G,(D) = 2 + ay D+ 5 (eet. 5: on Dee 


areealted the code generating polynomials of the encoder. 


= 0, no wire is present and, if 


ietabetice. i at gt?) = 








L 


| | iat lame velay Element 


~ Constant Multiplier 


~ Modulo-2 Adder 


Ruewre |. General Binary Rate PC omic lur 1 Oma! Encoder. 
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git) mem Mice on Piescil. Lf the generating polynomiais 
feeevime—-invariant, the encoder is known as a fixed convolu- 
Ta2Onai encoder. 

One approach to looking at the encoder is noting the 
Outputs at time k. 


(5), 


co 
eee 


Van e j = 1,2 (modulo-2 sum) 


0 


iE 


This is the convolution of the sequence 


oJ) 2 3) 669) old 


with the sequence 
Xi 2XyoXooeee 3 


hence the name "convolutional" code. 
ee xs 
The D-transform, Y;(d), of the sequence {yy Jas 


given by 


Y,(D) ~ G_(D)X(D) ; pes dy 


where X(D) is the transform of the input sequence. There- 
fore, as in continuous linear systems, convolution in the 
time domain corresponds to multiplication in the D-transform 
domain, where, for binary systems, the multiplication is 
performed modulo-2. 

Another convenient way to view convolutional encoders 
i—encoulea a Matrix description. Using Forney's stipulation 
(litle ea Convolutional encoder is a causal linear circuit, 


it can be assumed that the information sequences begin at 


fei 





imc zero. | Ihereifore, for a rate % fixed convolutional 


encoder, the information sequence is 


X = ee teeny | ; 


pmemriie COrresponding output sequence is 


y= [962g 62) yy l2) y299@),_..] 


The encoding equations for the encoder can be written 
Y= XG, 


where for an encoder with memory m, 


t=) 


q2 
oP) 
q2 
[G2 





15 called the generator matrix and 


mai e) ee.) ee 
G. = ef Ee Is Ce ara 


Encoders utilizing generator polynomials which vary 
with time, u, are known as time-varying convolutional 
encoders. If G, Cu) = G.(u il) Pema oO. Lhe encoder is 
a periodic time-varying convolutional encoder with period T. 
The generator matrix for a time-varying, rate % encoder with 


memory m is given by 


gw 





G,(0) G,(1) G2) ... G& (m) 0 e) 
eee ee eee Ga tm) G(mt1) 0 
G = 0 O G42)... G_4(m) G__4(mtl) G (mt2)... 


where G,(u) = jefe ef) a)]. 


Sescelioulsi. p. CL, has given a theorem which indicates 
Mieumumere exists at least one non-systematic, periodic, 
time-varying code with decoding properties which may be 
vastly better than those of fixed codes. The theoren, 
waesem Will be further discussed in Chapter II, is the major 
fietecer Waieh prompted the searcn for such a code in This 


fmesearch project. 


eee lnee of RUCTURE OF CONVOLUTIONAL CODES 
Now consider the rate %, memory-2 encoder in Figure e. 
Mne delay units can be a two-stage digital register. In 


Chis case 


ai 


G,(D) 


ee Dot a 


G,(D) 


and the code generated is called systematic. This term is 
used for codes which have the property that the information 
sequence appears explicitly in the output. Had G,(D) con- 
tained other non-zero coefficients of powers of D, the code 
would have been non-systematic. 

To see how the convolutional encoder constructs the 


coded output codeword, initially set all stages of the 


oe 





molaeer LO Zero, sequentially shift information bits into 
meee register and after each shift, observe the outputs ei 
and Yo: For example, the information sequence 1011 

will yield the encoded sequence 11 011010... as the 
transmitted symbols. 

From this example it can be seen that the transmitted 
Symbols depend on the present and two past information bits. 
Wiewstructure of the set of all output codewords can be 
Soemeirom 42 code tree, constructed as follows. For an 
mirormation sequence, X = [XQ >Xyo--+o%_q], the set of all 
2 kL—-component input vectors is diagrammed on an input tree 
Mem@ae ene Convention that the upper branch diverging from 
emode corresponds to shifting a@ zero into the encoder 
meersver and the lower branch to shifting in aone. The 
@ege tree 1s completed by adding to each branch of the input 
mMecemtne OULDUL digits associated with it. Using the example 
Semen previously, the tree of Figure 3 is constructed. It 
can be seen that each possible information sequence defines 
@ unique path through the tree. The encoded sequence of 
eremeronp le as shown by the bold path in Figure 3. The 
Pemcepomer the tree structure of convolutional codes leads 


(imeecolne to a discussion of sequential decoding. 


Poy SSE QUENTIAL DECODING 

Sequential decoding, introduced by Wozencraft[4], is 
Preeoadbiiavstic im nature. The decoder has available, or is 
Boilemee calculate, the channel error probability character- 


isties and a copy of the code tree used by the encoder. 


Ly 











¥9 


Figure 2. Binary Rate % Encoder of Memory Two. 


00 





il 


Figure 3. Code Tree for the Encoder of Figure eae 


ies 


pequential decoding algorithms cannot, in practice, con- 
struct the complete tree for each received sequence since 
Eme number of nodes grows exponentially with the length of 
Wm@essequence. The decoder in actuality maintains a replica 
eeuine Convolutional encoder. Wozencraft and Jacobs [5], 
p. 426, noted that the input, X, to the encoder may be 
regarded as a set of instructions which direct the encoder 
on & unique path through the code tree. Consider a binary 
symmetric channel (BSC) and a rate 4% encoder. The decoder, 
fend replica of the encoder, starts at the first node in 
the code tree, generates both succeeding branches and fol- 
lows the one that agrees most closely with the received 
Beguence. The process continues until the decoder reaches 
one of the Be temminalenodes for an L-bit information 
sequence. At this point the sequence is decoded. In the 
@ase when the channel 1s noiseless, the Result 1S trivial. 
Provided that both branches diverging from any one node 
eect ieauelmedst One bit. Such a difference may be 


guaranteed by ensuring that g as can be seen from 


Figure 2 and the resulting code tree of Figure 3. 

When noise is introduced over the channel, the foregoing 
process is not sufficient to decode a message. In this 
case, if neither branch emanating from a node corresponds 
in all places to the respective received bits, the decoder 
follows whichever branch agrees best. If the decoder makes 


Meteo ages paruicular node, it is unlikely to find a 


path along subsequent branches which agrees well with the 


16 





memainder of the received sequence. At this point the 
Gecoder is programmed to go back to the last "Best" node 
ene search another path. In practical decoding algorithms, 


a metric value is assigned to every branch in the tree. If 


i= [¥y2¥oo-++ oY, | 


are the code symbols on the branch and 


I [ry sPos--- ory | 


are the corresponding received symbols, then the branch 
iiecrrc 15 taken to be 


n ira ven 
a= £ | Lo ==5)3) (ae geal 
noe 2 Gay ry ( ) 


ab 


where Pir, |y,3} is the channel transition probability funec- 
aon , p(r, ) is the nominal received symbol probability 
aensity function and B is a bias term. Proper choice of B 
will ensure that, on the average, metric values along the 
Sortrect Path are pesitive while those along the incorrect 
path are negative. Nodes are assigned values equal to the 
witimor Che branch metrics along the path leading to the 
node. The decoder need only look for a path with generally 
mmereadsing Value to find the correct path. 

C, the number of computations performed by a sequential 
decoder, can be defined as the number of nodes examined in 
UMemsearch for a path through the tree. C is a random 
Variable, since the number of computations performed 


depends upon the received sequence, which in turn depends 


Ly 





upon the channel noise. Jacobs and Berlekamp [6] have shown 


miate the probability distribution function of C behaves as 
BO aes KN” 


for large N, where op is a number depending only on the 
channel and the rate of the code, and K varies slowly with 
ifeeelne distribution is termed as Paretian. This unfor- 
mae@eave behavior of the distribution of computation seems to 
be the major drawback to the use of sequential decoders. 
The implication is that decoding speed is a variable and 
fPercerved data must be stored in a buffer as received until 
it can be processed by the decoder. The Pareto distribution 
muecompucations indicates that there will be times when the 
fecoder will fall so far behind that the buffer will over- 
flow. In these cases there are two options: 
“Goeebivwdes che information sequence into "frames." 
Viet thes wutter evertlows during a frame, put the 
frame aside to be processed later and let the 


decoder start the next new frame. 


(2) If overflow occurs, request that the transmitter 
SvOp we mesyMeh onze, ang begin Sending again. 


It can be verified that C < », if and only if p > l. 


Wive, code rate such that 9 = 1 is called Reomp ° The signifi- 
memeeror this 1S that for rates R < Romp? C is bounded, 
while for R > Romp? C=, Therefore, decoding is con- 


paigdietaogly more Gditticult at rates substantially above 
B omp: Usually, in sequential decoding, Romp is greater 
than or equal to one-half channel capacity. 


One major advantage to sequential decoding schemes, 


exemplified by Gallager [7], p. 284, is the fact that the 


18 





meepability of error decays exponentially with encoder 
memory m; thus reliability can be increased as much as 
desired with relatively small increase in encoder complex- 
ity, and almost no change in decoder complexity. Another 
advantage is the relative ease of implementation of sequen- 
tial decoding systems versus other systems with comparable 
fmemiability. 

These advantages of sequential decoding weigh so heavily 
that, in spite of the necessity of operating at rates sig- 
Waeeeany ly below capacity, it is generally recognized that 
systems employing convolutional codes and sequential decod- 
ing are the most practical means of achieving high- 
reliability, low power communication over memoryless 


channels. 


E. BINARY SYMMETRIC CHANNEL 

inf Olenoulebiesexperimental phase of this research pro- 
ject, the binary symmetric channel was used as the channel 
model, and it is shown in Figure 4 for completeness. With. 
OuobabiLlity gq = 1 — p;, the output symbol is a replica of 
At miouv symbol. and whieh probability p, it is the comple- 
feomepeon une Gmpue., Those crossover probabilities, p, with 


corresponding R Chanticlecapachpy wand) 0 ULilizged in 


Comp. 


Sale eemeare Itsbeqd in Vable 2. With R= 4%, these choices 


of p represent operation at approximately Romp and ten 


percent below Romp’ 


oe 





Input Output 


Figure 4. Binary Symmetric Channel. 
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fipie. le) olvavist.cs for Channel Models used in Simulation. 





Ti. DISTANCE DEFINITIONS AND BOUNDS 


The distance between codewords in a convolutional code 
is one measure used in analyzing the error-correcting capa- 
DPaercies Of the code. In this chapter, several different 
distance measures will be defined for convolutional encoders 
and some established lower bounds on these measures will 


be shown. 


Pee Otol ANCE MEASURES 
1. Minimum Distance 
Massey [8], p. 15, has defined the minimum distance, 
din? of a convolutional code to be the smallest number ‘ont 
symbols in which two initial codewords differ that do not 


Meese 1dentical sets of first information symbols. That is, 


aes ¢ t 
X #X! 
=o" +o 
where d,.(Z 42") denotes the Hamming distance between the two 
arguments, [Z]_ means the first (m+1) blocks of the sequence 
Z, and m is the memory of the encoder. Generalized to time- 


varying encoders, this becomes 


= yt . 
cae min min 4d,, CS Cas (eGR ) 


il 
ie O<u<w X #X! ie 
= —u’ =u 


If the code is periodic with period T, the definition reduces 


to the following: 


zeal 





CUR ot eT ee le GS) 


{x 'G} 
ee Omeoi< TT xX. +X" H 
— =u =u 


Um = Ut 


ye 


Minimum distance, so defined, is also known as Feedback 
Decoding Minimum Distance. The term "feedback" derives from 
the fact that in some schemes of decoding, error propagation 
eecurs as a result of internal feedback in the decoder. 

That is, decoded versions of prior sequences are used to 
decode future sequences and earlier decoding errors can 
affect future decoding. On the other hand, decoding methods 
Mevine® no internal feedback have been termed definite 
@ecoding by Robinson [9]. 

Mestbello [3], p. 25, has fSiven an argument to show that, 
insofar as distance properties are concerned, it is not 
necessary to consider non-periodic time-varying encoders. 
iMtieewehoul the rest of this chapter, all time-varying 
encoders will, therefore, be considered to be periodic. 

Zeeeeorder—)|) Column Distance 

If the encoder input is a binary sequence beginning 
pemeae "1". and the encoder output is observed up until 
mime), the order-j column distance, ie is the maaaermum 
nemenp Ol all Such OutpuL sequences. For a periodic 


eSmecoder , oe is given by 


oe = min i¢jalaa tere Veemes calle. ame 


t 
IGG kt Ok ee ee 
_ —uU —u 
cone seo eed od. = bim d.. From the foregoing 
| > 


jetinicrons of mManimum distance, it can be seen that 


ee 





3. Free Distance 

In a convolutional encoder of memory m, any partic- 
ular information symbol can affect the output sequences 
Peer, at most, (m+l) time units. During this time, for an 
(m@,k) encoder, a total of (mt+t1)n symbols are transmitted. 
The code is said to have a feedback decoding constraint 
length, a (m+1)n symbols. Since sequential decoders are 
not limited to consider only one constraint length of 
received digits while attempting to decode a particular 
block of transmitted digits, a more meaningful distance 
measure called free distance has become used. The free 
distance is defined over the entire encoded sequence, and 
thus is a more appropriate distance measure for a decoder 
which. considers the entire received sequence in making a 
decision as vO which symbols were transmitted. 

Free distance has been defined as the minimum weight 


encoded sequence such that X # 0. 


a = min W,, (X G) 
free X#0 H 


where WZ) denotes the Hamming weight of the argument. It 


can be shown that dp = Lim d.. Simeceebrees distance 1s 2 


rec jr 


property of the code itself, it appears that this is the 
distance measure of concern when considering time-varying 


codes. 


Pee SOUNDS ON DESTANCE MEASURES 
Tt is desirable from an error-correcting capability 


standpoint to maximize the particular distance measure 


as 





with which one is concerned. Although it is not always 
clear how to construct codes with good distance properties, 
io iS possible to calculate bounds on these distance 
measures. 

1. Feedback Decoding Minimum Distance for Fixed Codes 

Wewmenerearreond Heitten | l0l, p. 5 and Massey [8], 

p. 15, have shown that there exists at least one fixed 
binary convolutional code with a given rate R, and con- 
Sieeaint length Ny» SUC mila e Caan is the largest integer 


which satisfies 


H gala | bk 
A 
where H(x) = - [xLog,x + OE roe, (lax) isp ielole, leslie eacny 
e@tropy function. since fixed codes can be considered to 


Besperiodic codes with period one, this lower bound also 
peoliles to the class of periodic codes. This bound is 
asymptotically the same as Gilbert's lower bound on 

minimum distance for block codes with the same rate and 
Pemstioainu length (lilly he Gilbert bound is a universally 
peecepuca criterion of Comparison for codes. 


Pebetanicve Decodine Mianwmun Distance for 
systematic Periodic Codes 


Wagner [12] , has shown that there exists at least 
one binary convolutional code with period T = m+l, and rate 


R, such that 
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where q_ and n, are, mespectively, different definitions of 
definite decoding minimum distance and definite decoding 
@oniseraine length given by Robinson [9]. This bound is 
only satisfied for R < %. Wagner was the first to derive 
mecaiberty bound for this class of codes and proved that the 
moma holds for a class of systematic codes of period 

fe (3mtl)/2 if m is odd or T = 3mt+l if m is even. This 
Peomvune first class of codes investigated in this project 
and will be further discussed later. This bound has been 
extended to all rates by Costello and Morrissey [13] to the 
Following: There exists at least one systematic, periodic, 


time-varying convolutional code such that 








IND: 1-R 
Poise | oe, 
Nyp 1+ : 
where dnp and Npp are Robinson's definite decoding parame- 
ters. 
3. Free Distance for Non-systematic Periodic Codes 


An obvious lower bound on free distance can be 
obtained using the following facts concerning minimum 


Gistance and column distance: 


= ° = j . p > Z 
tin = 9m > “Pree re a 
Therefore, d... deree and all lower bounds on d., are 


also lower bounds on Bae 
Costello [3], p. 81, has proved a lower bound on 


free distance for non-systematic, periodic codes which is 
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much tighter than corresponding bounds for fixed codes. His 
result states that there exists at least one non-systematic 


meritodic code such that 


d R-l 
Lim Preem ar el a2 ) 
R-1) 


m0 en SenCiee PR awl 


This lower bound is very close to the generalized McEliece 
and Rumsey upper bound for non-systematic fixed codes [3], 
pe 95. The tightness of this lower bound and its closeness 
to the upper bound for fixed codes suggests the existence 
ee periodice codes which achieve a much lower probability of 
@eeeqging error than corresponding fixed codes. It is of 
i@eerest , therefore, to find such codes and Co determine 
memvneir superiority over fixed codes is sufficiently great 
to justify the additional complexity of a time-varying 


encoder. 
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eee ULATED SEU NTEAGS DECODER 


pequential decoding, as discussed in Chapter I, is a 
Mmemaod for decoding information which has been encoded, 
wees tree codes, for transmission over a noisy channel. 
several sequential decoding algorithms have been introduced 
emer cested. In this chapter a detailed description of the 
algorithm used in this work will be given along with an 
explanation of the use of the algorithm in an attempt to 


construct good time-varying codes. 


felon DECODING ALGORITHM 

The algorithm used, suggested in independent work by 
Zigangirov [14} and Jelinek (15), is simple to describe 
fie witch modifications proposed by Jelinek, is faster than 
Guhner competing algorithms. In order to attain the speed 
advantage without an increase in error probability, the 
memory required for use by the decoder must be increased 
considerably. A description of the basic algorithm without 
modifications follows. 

As stated in Section I1.D, metric values are assigned to 
each branch in the code tree. This metric value, given by 
equation (1.1), is a branch likelihood function. The sum 
of the branch likelihood functions on a path leading to a 
particular node is called the node likelihood value. The 
decoder consists of a portion of computer memory called 


the stack which is an ordered list of nodes. The stack is 


eq 





erlangzed in decreasing order of node likelihood values with 
the highest node having the greatest value of all nodes in 
Mie stack. The stack is first loaded with the value of the 
eeein node which is, thus, the "top" node in the stack. 
The decoder then proceeds as follows: 
(1) Compute the likelihood values of the two successors 
to the top node and place them into the stack in 


order determined by their values. 


(2) Eliminate the node whose two successors were just 
added. 


oe thesnew “too” node is a terminal node in the 
tree, stop. Otherwise go to (1). 


In other words, after the Eee 


Steo,, one stack Will contain 
Peeeculy Ktl likelihoods corresponding to paths of various 
lengths and different end nodes. On the (k+1)8* step, the 
@ecoder searches the stack to find the largest stored like- 
Linood, determines the path to which it corresponds, and 
replaces that likelihood with the likelihoods of the two 
suecessor nodes. When the process halts, the top node in 
the stack determines a path from the origin node to a 
terminal node in the tree. 

Corse lol, p>.) 30, Nes sshown thay the Zipangirov— 
Jelinek algorithm chooses a path Sp oSy oes Sy through the 
Peeenwhten Savtisiies the following conditions: 


(1) s, is the origin node. 


0 


(2) The branch leading from any particular node, s;, 
to a node in the next level of the tree is the first 
Pranechmeusenes Ollume Pabhs from is4 vo The end oL1 
the tree having the greatest minimum likelihood 
value. 


imeessence. the result of decoding is such that the 


decoder picks a node, checks all paths from that node to 
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the end of the tree to find the one with greatest minimum 


value, and "moves" one node farther along that path. The 
E¥e@ocess repeats until a terminal node is reached. To meet 
the essential feature of sequential decoding given by Jacobs 
and Berlekamp [6], the branches must be examined sequen- 
tially, so that at any node of the tree the decoder's choice 
among a set of previously unexplored branches may not depend 
On received branches deeper in the tree. Therefore, the 
decoder does not in actuality look ahead on all possible 
paths, but selects for a node to be extended, the one with 
gereatest likelihood value from the set of all nodes in the 
Sack. 

Since the decoder performs one computation for each node 
it examines, and with non-zero probability the number of 
nodes examined grows quite large, there is a possibility of 
stack overflow. In simulation studies this was handled by 
pmeeessation of decoding of the particular frame during which 
overflow occurred and starting the next frame. The frame 
which caused overflow was then counted as an erasure. 

A problem with the Zigangirov-Jelinek algorithm is the 

excessive time required to keep the stack ordered so that 
the nodes are in decreasing order of likelihood values. 
This problem is alleviated when the algorithm is modified 
as proposed by Jelinek [15]. The modified version, now CO 
Dewees scissed, is the one which was used in the experimental 
Boase Of Chis work. 

The modification consists of quantizing the likelihood 


values and placing nodes in ordered bins according Toone ae 1 


2g 





values. The stack is then arranged as random access storage 
with descriptions of each node examined placed into the 
stack sequentially from the top. Decoding proceeds as 
Peas Lows : 
(1) Select a node from the highest non-empty bin, com- 
pute the values of its successors, and place them 


iieonie proper bins. 


(2) Eliminate from further consideration the node whose 
Successors were just added. 


(3) If a node in the highest non-empty bin is a term- 
inal node in the tree, stop. Otherwise, go to (1). 


In each case when a node is placed in a bin, its description 
fceotaced on the stack. 

Geist [17] has done extensive computer simulation studies 
which indicate that this version of the Jelinek algorithm 
ited most cases of interest, superior to the Fano algor- 
ithm [18] as long as sufficient computer memory is available. 
A detailed discussion of the process followed in the decoder 


program is given in Appendix A. 


Pee usoh OF THE DECODER FOR CONSTRUCTING CODES 

Memuasceouated in Chapter Ei, the error—correcting capa- 
Dilities of a code are closely related to the respective 
weights of the codewords. Forney [19] has given a method 
for determining the codeword weights by using a sequential 
decoding simulator. His method is outlined for a simulator 
using the Fano algorithm for determining the codeword 
Memphis, of fixed codes. in this project the method was 
suitably modified to use the quantized Jelinek algorithm iene 


constructing time-varying codes with good distance properties. 


Bye 





Since with time-varying codes, free distance appears to 
be the most appropriate distance measure, and free distance 
is related to order-j column distance, the decoder was used 
momimeasure the column distance of successive codewords. 
With this value available, an attempt was then made to 
select subsequent generator polynomials with the aim of 
maximizing the minimum order-j column distance. 


Mie steps in the procedure are as follows: 


(1) Select the first generator polynomials, ae such 
taeda —veee SU ies) 1, f= 2. 
Note: k ieTtOr-sysvucmavic “codes. 


k ine nor non SsVowelaule eCoCdes. 


Ck) 


(2) Make a choice for G. 


(3) Using these generator polynomials and the decoder, 
Searcn to level 3 in the tree. 


(4) Compute d,. If d, > d,_, go to ar 


(5) If all choices for GS? 


; Anemeenauabedanco) boy). 


(6) Make another choice for oe GCoreours). 

Ceueite = Merthe period Gf the code, stop. Otherwise, 
ee ee ee ee and seo. tem cc). 

fiper this process was Completed, it was a Simple matver 


wemmModity the computer program to test the code thus 


generated. 





iv “CONSTRUCTION OF TIME-VARYING CODES 


In this chapter, the several methods employed in an 
attempt to construct good time-varying codes will be dis- 
cussed. Included will be the reasons for searching for a 
eee, Ol the particular class, and a comparison to the per- 
formance of fixed codes of the same memory. The distri- 
meron Of computations, number of frames erased per 1000 
-frames, number of error frames per 1000 frames, and bit 
Siror probability are compared for each code generated. 

All codes generated were of rate % and comparisons were 
made over simulated binary symmetric channels with cross- 
over probabilities p = 0.03125 and p = 0.04688. For each 
code, an attempt was made to decode 1000 frames of length 
mage bits at each of the two channel probabilities. Through- 
out simulation, the all-zero sequence was assumed to have 
Meeawetransmitted. Since the nominal probability of a 
transmitted symbol being a zero or a one is one-half, no 
Mesceot generality occurs, buy this affords the decoder an 
imeatr advantage. For this reason, the decoder was pro- 
grammed to choose the "one-branch" in cases where ties 


occurred. 


A. SYSTEMATIC TIME-VARYING CODES 
1. Wagner Codes 
Wagner [12] suggested a class of systematic, 


periodic, binary convolutional codes for which base Gal bere 


Be 





bound applies. The encoder is depicted in Figure 5(a). As 
before, if g, (u) = 0, no wire is present, and if g,(u) = 1, 
a wire is present. The generator sequence, By (u),.--,8,(u), 
merormed from the leftmost (m+1) bits of the generator 
meeisver shown in Figure 5(b). Each time unit, the infor- 
Mavion register shifts right once and the generator register 
fees Circularly twice. The period of the code is 
eeoeomtl if mis even and T = (3m+t1)/2 if m is odd. 
Wslig@etne fact that the output sequence from a 
k-Sstage maximal length feedback shift register is periodic 
taeem period ae a five-stage MLFSR was used to generate 
codes of m = 10 with T = 31. <A complete discussion of feed- 
bere shift registers is contained in Peterson [20], p. 147. 
iemeenerate the code, coefficients of all primitive poly- 
nomials of degree five were tried as the pattern of taps on 
Che MLFSR. The code generated which gave the best perfor- 
iMemee 1S compared in Table II to the performance of a fixed 
systematic code constructed by Costello [3] for high free 
G@istance. Costello's code was constructed for m= 35 
Mioeeius) and taking the first 11] bits to form a memory ten 
@ege actually resulted in a generator Penonitenl with m= 9. 


Mpewtruneated version (in octal form) is: 
ea 


Two modifications of the generated Wagner code were 
armed in an effort to imMpmove Iocrlornance. Eimene Tiree 
foemwcation, called “Wagner (Mod 1)", the code was gener- 


pedmas betore With the exception thal it was insured that 


oe 
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(a). Time-varying Encoder. 


Generator Polynomial 
an oeeeneemnmnnncann sata oe OE, 
(ob). Generator Register. 
1 Encoder for Wagner Codes. 


Figure 5. Convolutiona 
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CODE ERROR BIT ERROR ERASED 








FRAMES PROBABILITY FRAMES 
eee nl 
Wagner (p = 0.03125) 200 0.00200 0 
Costello (p = 0.03125) We G1. (Overale) aL 0 








Wagner (p = 0.04688) NOS 
Costello (p = 0.04688) 323 
(a). Errors and Erasures. 
; ‘a, ame 
N 300 500 | 800 1000 | 
Wagner (p = Geese >) | 638 We | 2 0 
| , 
\ 
Peeeaiics (p= ses le5) 252 2 | 1 pe | 






| 
Wagner (p = 503 55 | 3 0 | 


Costello (p = 0.04688) 


(bo). Frames with Number of Computations > N. 


Table Ii. Comparison of Wagner Code to Fixed 
Systematic Code Gm = ies 





mie oresent information bit was included in the parity-check 
sequence (i.e., Eq (u) — le tOreall UW). winesresults tompared 
memcostello's code are given in Table III. 

This modification gave only a small improvement over 
mime true Wagner code with the bit error probability at a 
channel error probability of p = 0.04688 being slightly less 
moa that of Costello's code. 

In the second modified version, the memory of the 


encoder was increased to 12 and g,(u),.. (u) were gen- 


oie 
erated as for the true Wagner code. It was then insured 

eer the oresent information bit and one past information 

bit were included in the parity-check sequence (i.e., 

By fu) = g,(u) = 1 for all u). This code was called "Wagner 
(Mod II)" and Table IV shows a comparison of results obtained 


memenose obtained using Costello's code Bith m= le. The 


immed code generator polynomial (in octal form) is: 
Cer 


As expected, this code was an improvement over the 
true Wagner code since the memory was longer, but the code 
did not show improvement over a comparable fixed code. 

Peet ty Reeisver. Codes 

These codes were generated using a 24-stage maximal 
length feedback shift register. The first, called "Code A," 
was formed by taking as the generator polynomials each 
successive 24-bit output sequence obtained after shifting 
the register right two bits. The second, Called "Code B," 


was formed in the same manner except that the output 
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BIT ERROR 
PROBABILITY 


i Sa eee 


Wagner (Mod 1) 
= Oeil 2>) 


ERASED 
FRAMES 




















@ectello (p = OrOB25) fez Ds OomLen 0 


it 0.00604 0 


B23 | 0.00614 | 1 | 






Wagner (Mod > 
(p = 0.04688) 












@estello (p = 0.04688) 


a med 
pee A Se SS TE . 





Gee eens and Erasures. 





Wagner (Mod TI) 

(p = 0.03125) | aes T | a fe 
Wagner (Mod i) 1 

(p = 0.04688) 





(bo). Frames with Number of Computations ? N. 


Pelle IUIEie Comparison of Wagner (Mod ico de 
eo fa xed Systematic Code (m = 10) 





ERROR Biveeenon § ERASED 
FRAMES PROBABILITY FRAMES 


Wagner (Mod IT) 
(p = 0.03125) 64 0.00093 0 






Gestello (p = eos 25} 28 0.00051 0 


Wagner (Mod ok) 


Costello (p 0.04688) sae | 0.00378 | 0 


ER mean ainannaan ae aa 


| 
| 
| 


ae aegis a Te 


————a et LT, 


Cay werrors and Erasures. 


Wagner (Mod cai) | 
(p = 0.03125) 394 








Sostbello (p = Gamo te >) 






Wagner (Mod iL) 
(p = 0.04688) 





(>). Frames with Number of Computations > N. 


Table IV. Comparison of Wagner (Mod ioe code 
to Fixed Systematic Code (m = 12). 
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sequences were taken after St time cvone recgasver leic one 
bit. For performance comparison, Costeilo's taxed syste- 


matic code with m = 23 was used: 


CS 1 PEO) 4) Oly 
Again, performing the truncation on the m = 35 code yielded 
only a code with memory m = Me ode uferas chosen since the 


generator polynomials vary like those of a Wagner code 
although the period of the code is much greater than 
(3m+1)/2. Code B is a modification which was tested for 
comparison. Results are given in Table V. 

3. High Minimum Column Dirctance Codes 

This class of codes was generated using the algorithm 

outlined in Section II.B. The algorithm is a modification 
pe@ostello's algorithm Al [3], p. ie eeor consLrucy ing 
rate &, fixed, systematic codes with high free distance. 
The difficulty with trying to construct fame-varying codes 
sn this manner is brought about by the fact that when 
deciding upon the generator polynomial, G(u), none of the 
polynomials, G(utt), 1 < t < T-u, are known. Therefore ; 
one cannot measure the order-j column distance, elas for 
Wee uw bo gel an estimate Sf tne magn bude Of Oe for one 
polynomials chosen up to Paeuepoime. | ihe codes were Con 
Se mucyeU with the aim of maximizing d, for each step, keep- 
imeem mand that Vois method only gives high minimum column 
distance measured from the origin node and that the minimum 
column distance measured from other nodes may be quite low. 


The codes were constructed for a high OG Comparison vo 


De, 


ERROR BIT ERROR ERASED 
FRAMES PROBABILITY FRAMES 






Bede A (p = 0.03125) OyO0032 
aeetewto (p = 0.03125) 6 0.00014 
Code A (p = 0.04688) 91 | 0.00177 | 
. 

Code B (p = 0.04688) 104 | 0.00174 


Costello (p = 0.04688) lo + 0.00122 12 
| | ee 
! = l 


(a). Errors and Erasures 








Cpereiliue Gs =o) isaheb) 596 23 | yf 

Code A (p = 0.04688) 909 398 : ie 

Code B (p = 0.04688) 895 Sie 160 

ape eelue Coy = 0), OeMeters) 905 163 po | 
ieee eee with Number of Computations ° N. 


Table V. Comparison of Systematic Shift Regis 
Codes to Fixed Systematic Code (m = 


4O 


(a 


LOW, 


aa 


ie, 


cer 
PEG 





fixed code performance is given iieLoblems ee Tine codes were 
Menerated for m = 22 with period T = 35. Gosve llo's scode 


was used for comparison. 


B. NON-SYSTEMATIC TIME-VARYING CODES 

As was discussed in Chapter II, Costello. (3) derived a 
lower bound on free distance for non-systematic, periodic, 
convolutional codes which suggests that there exists at 
least one code of this class with decoding properties 
offering a great improvement over comparable fixed codes. 
For this reason, a search for members of this class of codes 
was conducted. 

1. Wagner-like Codes 

Since Wagner [12] was the first to offer any results 

concerning periodic codes, a non-systematic version oy Btleaits 
codes was tested. Both arrays of generator polynomials 
were constructed using the method outlined in Section Ly et 
for m= 10. The performance results were compared to a 
non-systematic, high free distance, fixed code Const rucved 
by Costello with his algorithm Romie oeoe lldem Costello’s 
code, again, was constructed for m = 35 and the generator 


polynomials (in octal form), truncated to m= 10 are: 


(1) 


| G2 


fee. 


(2) 


G =95 355) 


As before, truncation actually resulted in a code with m= 9. 


Performance results are given in abilie. Vil. 


ha 





ERROR Bll ERROR ERASED 
ne Pe PROBABILITY FRAMES 





High A325 (p = 0. 03125) Ss a 

High d,, (p = 0.04688) 210 0.00388 56 

Costello (p = 0.04688) bo | 0.00122 | 12 | 
a 
| : 





(a). Errors and Erasures. 
N 300 500 | 800 1000 | 
ee i eres. cue 
High dae (p = 0.03125) | 902 308 : 89 
} 
| 





QO. aan 


High dj, (p = 0-04688) | 787 480 





(bo). Frames with Number of Computations > N. 


Figure VI. Comparison of High 435 Code to 
Fixed Systematic Code Clee ase 
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CODE ERROR BIT ERROR ERASED 
FRAMES PROBABITAITY FRAMES 


aan 







Wagner Come 0: Cl Sleep. 2 IL 0.00042 8 
Costello (p = 0.03125) leg 0.00029 i) | 
Come en OPEOL TokortsD) ree 0700302 : aly 


Gosovello 0.00186 15 






z | | 
Costello (p = 0.03125) — 24 | 6 y 


0.04688) 


Costello (p = 0.04688) 


Frames with Number of Computations ? N. 
Table VIL. Comparison of Non- systematic Wagner- 


like Codes to Fixed Non- systematic 
Cedecwin = 10), 


yo 





Zero dmeenerister Codes 
This m = 23 code was generated in like manner to the 
systematic code of the same type (Code A) with the exception 
that a different 24-stage MLFSR was used to form each array 
of generator polynomials. Comparison of performance is made 
immiable Vill and Figures 6 and 7 to Costello's non- 
systematic fixed code, truncated to m = 23. .The generator 


polynomials for the fixed comparison code are: 


gC) 2 TSE Seay 


ge) 2 serene, 


Since no errors were made with either the time-varying code 
Sieve fixed code, the dominant parameter for comparison is 
MgemOicuribution Of computations. Therefore, plots of the 
distribution are given vice tables. As was stated in 
Oaapver I, the computation has an assymptotic Pareto dis- 


Mmmoucion of the form 


2 {@ SN) Sain 


The observed distributions for these codes are plotted in 
Figures 6 and 7 on a log-log scale. Therefore, the curves 
should approach straight lines whose slopes are the negatives 
of the values of 9 given in Table I. These asymptotes are 
asp layed in the figures. 

Lion uetieecmomeand ( 1b Can be seen that, although 
the shift register code made no decoding errors, the code 
caused the decoder to perform many more computations than 


teeta with the fixed code. 
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ERROR bit ERROR BRASED 
FRAMES Ee me ole, ey FRAMES 


eaitt Register 
fer — 0.03125) 


Costello 
(p = 0.03125) 


So1tt Register 
(p = 0.04688) 


Costello 
for = 0.04688) 





iegiesvill. Comparison of Non-systematic Shift Register Codes 
pomexedsNom—systemaric Code (m = 23). 
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poe Minimum Column Distance Codes 


Non-systematic, time-varying, high minimum column 
distance codes were next investigated. These codes were 
generated using the algorithm in Section II.B to construct 


two arrays of generator polynomials with a high da The 


35 
same difficulties noted for systematic codes of this type 
also pertain to the generation of non-systematic codes. 
Again, codes of m = 23 with period T = 35 were generated 
and Costello's high free distance, non-systematic code 
truncated to m = 23 was used for comparison. The results 
meemeoivem om Table IX. Pilots of the distribution of compu- 
tations are given in Figures 8 and 9. 

Mitnd@eouchie uae prooaoidaty of a decoding error is 
quite low with this time-varying code, the number of com- 
putations performed when using the code is much greater 
than the number performed when using a comparable fixed 
code. 

4, Complementary Codes 

Recently, Bahl and Jelinek [21] have investigated 
4 class of rate % fixed convolutional codes with complemen- 
tary generators. They have described a synthesis and a 
Search procedure that results in good codes up to memory 
Wee ole G4Odessconstvructed come close to achieving 
established upper bounds on free distance and the generator 


BPemynomials Satrtsciy the folilowing two conditions: 


(1) a? = eo” = git) = gee = al 
(2) g*) = ae eed. << in, 
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where g denotes the complement of Es The results 
of this report [21] suggested a search for periodic codes 
with complementary generators. 
a. High Minimum Column Distance Complementary Codes 

Ponsermetion of codes with high d2 5. was again 
avcvemptCed using the algorithm of Section II.B ensuring that 
the choices made for the generator polynomials satisfied 
the two stated conditions for complementary codes. Codes 
with m = 23 and period T = 35 were generated. Performance 
results are given in Table X with a comparison to the 
m= 23 fixed code constructed by Bahl and Jelinek. Plots 
of the distribution of computations are given in Figures 
foeand ji. 

b. Alternating Two Complementary Codes 

In this time-varying code, which is the last 
type investigated, generator arrays were formed by alter- 
nating two fixed complementary codes to give a code with 
Peigslocwle-meoe olmce the fixed complementary codes with 
m= 23 used for comparison make no decoding errors, it was 
qeewmeecdsvOuuse smorter memory codes which do cause some 
feo me rors so as tO have a go00d basis for comparison. 
Poamieeond e@elimek [21] have constructed a number of optimal 
complementary codes that have the largest attainable free 
jiewence ws Wie complete list of this set for 2 < m < 8 is 
Siven in the report. Two of these codes with m = 6 were 


chosen to form the period T = 2 code. The four generator 


polynomials (in octal form) are: 
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Table X. Comparison of Periodic Complementary 
Codes to Fixed Complementary Codes 
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Performance results for the two fixed codes and the periodic 
code are given in Table Xl. 

As can be seen from Table XI, the performance 
of the periodic code comes close to equaling that of the 
mecca ecOGces in bOoUnN Error probability and distribution of 
computations, but major improvement over the performance 


pera xed Godes is not exhibited. 
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Table XI. Comparison of Period-2 Complementary 


Codes to Fixed Complementary Codes 
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V. CONCLUSIONS 


In all types of time-varying codes investigated, the 
results obtained did not show improvement over the perfor- 
fmemece Ol comparable fixed codes. The most promising 
periodic codes appear to be those using complementary 
generators with the generator arrays formed by some manner 
Seeinvuerleavying optimum fixed code polynomials. Of note 
here is the fact that the Bahnl-Jelinek fixed convolutional 
eodes with complementary generators exhibited better per- 
formance than other fixed codes with longer memory. 

Further research into time-varying codes should include 
a study of the distance properties of goo@ codes with the 
aim of finding a systematic method to generate periodic 
codes with high free distance. Experimental methods might 
entail performing perturbations on the generator arrays of 
meme SemIeMOWl periodic code in an effort to improve per- 
ietemayce. 

Costello's lower bound on free distance for rate 4%, 
Pen=sysuemaric, periodic codes [3], p. 81, is an asymptotic 
bound which means that it may not necessarily apply to 
eodecmes snort econstraint length. This fact is exemplified 
i nem@es I towobeained in this work with periodic codes up 
to memory m = 23. The added encoder/decoder complexity 
required to generate long constraint length ee er ane 


codes is not practical when one considers that equally 
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bemwtable Communications can be achieved using less complex, 
shorter fixed codes. Time-varying codes, thus far, appear 


Meme Of theoretical significance only. 
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APPENDIX A 


DECODER AND ERROR PATTERN GENERATOR PROGRAMS 


All computer simulation was accomplished on the XDS-9300 
computer. A detailed discussion of the quantized Jelinek 
decoder and the error pattern generator programs will now 


be given. 


A. DECODER PROGRAM 

For every node the decoder encounters in its search 
through the tree, three items of information about the node 
tite De Saved so that the node can be extended if it becomes 
the top node in the stack. These items are the node like- 
tihood value, its depth into the tree, and the encoder 
state at the node. The encoder state is necessary so that 
the code symbols on the two branches emanating from the 
node may be determined; the depth is necessary so that these 
code symbols may be compared with the corresponding symbols 
in the received sequence; and the new node likelihood values 
must be obtained by adding the branch likelihood values of 
the two emanating branches to the extended node value. 

For the node to be extended, these items were saved in 
three computer storage locations with the symbolic labels 
Jittte weber. and OTATE respectively. For each node on the 
stack, six consecutive words of computer memory contained 
Miemecnmmsre Node description. in the first three of these 


Weems Pered the mode value, depth, and encoder state; the 
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last three locations contained a stack pointer, a path 
pointer, and a flag, all of which will be explained later. 

During simulation it was convenient to have all positive 
node values; so the origin Fone was biased to a value of 
1000 which ensured that no node encountered had a negative 
value. 

At the beginning of the search the origin node is the 
moeemode., iIherefore, DEPTH and STATE are initially set To 
oememeana VAbUE 15 set to 1000. During the search, the 
PMmiomnianton aeolu Gach node encountered is saved either 
me oOr WEP TH, and STATE, or as a node description on the 
Pmerek (or both). Since, in this quantized version of the 
mleoriuham, mode descriptions are neither rearranged in the 
meeokenor physically deleted from the stack, even if the 
Megenreaches the top of the stack and is extended, there 
are several node descriptions in memory which are no longer 
on the stack. Therefore, a method is necessary whereby the 
Ordering of the stack contents into bins may be accomplished 
and node descriptions which represent nodes still on the 
stack may be determined. The aforementioned stack pointer 
and two arrays called bin index and bin inventory are used 
Touebnis purpose. For each bin, the bin inventory contains 
tmeenumber of nodes in the bin, and the corresponding loca- 
tion in the bin index contains the address of the first 
Memeo he ode description for one of the modes in the 
ieee shack pointer for this node contains the address 
Mimricmitrst word of the node description for another node 


in the bin. The chain continues until all nodes in the bin 
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Bec linked Gogeuner with the stack pointer of the node 
description of the last node in the bin being empty. 

The size of the bin index and bin inventory arrays are 
determined by the size of the node likelihood value quan- 
tizing increment which was assigned the symbolic label H, 
and which was chosen so as to satisfy the following two 
@omcac LOns ; 


(1) His at least as great as the maximum positive 
branch likelihood value, normalized to an integer. 


(2) H is restricted to be a power of two (i.e., EH = 2") 
SQ that the proper bin in whieh to place a node can 
be determined by an r-bit shift operation. 
To find the value for H which satisfies the first condition, 
consider that when a node is extended and the two branches 
are compared to the received sequence, there are three 
possible outcomes: (1) a branch can agree with the received 
sequence in both digits; (2) a branch can disagree with the 
received sequence in both digits; (3) a branch can disagree 
im exactly one digit. The branch likelihood values corres- 
Bema to the branch metric values in Equation (1.1), nor- 
malized to integer values. For the three possible outcomes, 
Miemmleeriecsvalues, at each of the two channel probabilities 
were chosen as given in Table XII. From the information 
listed in Table XII, it can be seen that a quantizing incre- 
femiemitiichesoatcranied Doth stated conditions, and the one 
teededtirrne Simulation, was H = 8. 
The sequence of events during decoding i aeltalt now be 
eee VALUER, DEPTH, and STATE are set to the respec- 


tive parameters for the top node in the stack and the 
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Metric Values 


pe = Oedsies oe a) OG che 
Both digits agree 8 8 
Both digits disagree -72 -64 
One digit disagrees ~32 -28 


ole eNotes Valucemused an vsamulation. 


branch likelihood values for the two branches emanating 

from that node are computed. Now there are two possible 
Peees: either (1) at least one branch value is positive, or 
(2?) both branch values are negative. The two cases will be 
considered separately. 

Mesce Cl). If at least one branch valle is positive, the 
emleeessor node along that path must belong in either the 
Same bin as the extended node or a higher bin and, there- 
fore, the successor node must be the new top node. VALUE, 
beer, and SPATE are adjusted to the corresponding parameters 
momebne new node and the node description for the other 
Piicieessor must be stored on the stack. The first three 
items are computed from the parameters stored in VALUE, 
DeeNh, and STATE along with the calculated branch value. 

The integer part of the successor node value divided by H 
determines the proper bin in which the node belongs. the 
baeirmwentory for this bin is increased by one, and the 


stack pointer of the new node description is set to the 
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feeteeso Which 1s SsvOored in the corresponding location of the 
Pemex. Ihe bin index is then set to the address of the 
Peiest Word Of ~The new node description. The path pointer 
and the flag, which will be discussed later, are used to 
recover the information symbols on the chosen path after a 
search ends on a terminal node in the tree. They are now 
set and the decoder is ready to extend the new top node 
Moen tne present parameters in VALUE, DEPTH, and STATE. 

Case (2). If both branch values are negative, it is 
clear that there may be nodes on the stack which have 
greater likelihood values than the two successors, and 
therefore belong in higher bins. First the two new node 
Besecripcions are stored on the stack. Now, since the 
extended node was in the highest non-empty bin, the decoder 
Searches down the bin inventory array, starting with the 
meer) Which the extended node was located, until it finds 
pment With mon—-Zero inventory. When This bin is located, 
the inventory is decreased by one, VALUE, DEPTH, and STATE 
are set to the respective parameters from the node descrip- 
tion located using the address in the corresponding bin in- 
fe wonder nes bin index is set to the stack pointer address 
foreepiniat node. The decoder is now ready to extend the new 
nec. 

As was stated earlier, each frame is 256 bits long which 
yields a 256 branch tree. The 256 branches are followed by 
an m=-branch tail corresponding to a memory aera Of Zeros. 


CIcewlte is kKmown that only zeros are transmitted in the 
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ween ume Gecoder considers only the zero-branch successor 
Brreims 10S search in the tail. If the branch value is 
mesttive, no node description is stored and the successor 
node is extended. If the branch value is negative, the 
eee@eessor node description is stored on the stack and a new 
top node is located in the same manner as described in 

Case (2) earlier. 

When the contents of DEPTH is (256 + m), the search has 
ended on a terminal node and the decoder must recover the 
inatormation symbols on the chosen path. The last two items 
meine mode description are used to accomplish this function. 
Hea a description of every node encountered been stored, 
the path pointer could have been set to the address of the 
@eeeription of its predecessor and a@ path from the terminal 
node to the origin would easily have been determined; but 
memes Not the case, since, in many instances, only one 
Megenadescripticon is stored. The path pointer is set to the 
feeress of the description of a node's predecessor if it is 
meemed. Or, te the address of the node at the end of the 
second branch emanating from the predecessor if it is not 
ppercd. Lneche lauter case the flag is used to indicate 
Masriers ene Davin pointer leads to the predecessor or the 
second branch. The decoder can then follow a path back to 
the origin to retrieve the information symbols along the 


Pouneesc lected. 


65 


— 





B. ERROR PATTERN GENERATOR PROGRAMS 
1. Binary Symmetric Channel (p = 0.03125) 

The binary symmetric channel with crossover prob- 
Soataty 0.03125 = 1/32 was simulated using a ee ee 
maximal-length feedback shift register. The periodic 
sequences from a MLFSR are called "pseudo-noise" (or p-n) 
sequences. If a sequence of i digits (i < m) is picked at 
random from the output sequence of an m-stage binary MLFSR, 
then each non-zero sequence has probability PaaS) and 
the zero sequence has probability ey ae There- 
memes With a 23-stage MLFSR, an all-zero sequence of five 
orcs wil) occur in the output with an approximate prob- 
meemiey Of 1/32, Since the all-zero sequence is easy to 
detect with a digital machine, and since it was assumed 
Meee che all—zero string of information bits was transmitted, 
the error pattern generator was programmed to insert an 
error bit (i.e., change a received symbol to a "1") each 
time the five-digit zero sequence occurred in the output of 
the MLFSR. This, then, happened with a nominal probability 
Qn se . 

2. Binary Symmetric Channel (p = 0.04688) 

This channel with crossover probability 0.04688 = 3/64 
Wee also Simulated using a 23-stage MLFSR. In this case, 
eachetume the five-digit zero sequence occurred, the error 
pattern generator was programmec to insert an error bit 
(probability = 1/32). If the five-digit zero sequence did 


not occur, the generator then checked for a six-digit 
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sequence of zeros. If the six-digit sequence of Zeros was 


present (probability = 1/64) the error bit was inserted. 


Therefore, the overall probability of occurrence of an 


error was [(1/32) + (1/64)] = (3/64). 
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